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MULTI-DIMENSIONAL DISCONNECTED MESH SWITCHING NETWORK 
5 BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to switching network and more specifically to a fault 
tolerant multi-dimensional disconnected mesh switching network for high speed large scale 
10 efficient packet switching. 

2. Description of the Related Art 

High speed packet switching is a key technology for Broad-band Integrated Services 
Digital Network (B-ISDN). Currently, Asynchronous Transfer Mode (ATM) is receiving 
tremendous attention for the next generation of communication technology. The ATM was 
15 defined by the CCITT (currently ITU-T) which is the United Nations (U.N) body which 
defines future telecommunication standards. The basic Protocol Data Unit (PDU) of ATM, 
which is called a cell, has a fixed length of 53 bytes. ATM switching can be classified as 
part of the larger category packet switching. 

The high speed packet switch is a key technology for B-ISDN technology. There 
20 are many requirements for the architecture of a high speed packet switch, such as a 
modularity and high fault-tolerance, which contribute to easy implementation and good 
quality of service. Such technology is disclosed in "ATM Technology for Corporate 
Networks", IEEE Communications Magazine, pages 90-101, April, 1992. 

A packet switch is a system that is connected to multiple transmission links and does 
25 the central processing for the activity of a packet switching network where the network 
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consists of switches, transmission links and terminals. The transmission links are connected 
to network equipment, such as multiplexers (MUX) and demultiplexers (DMUX). A 
terminal can be connected to the MUX/DMUX or it can be connected to the packet switch 
system. Generally, the packet switch consists of input and output transmission link 
5 controllers and the switching network. The input and output link controllers perform the 
protocol termination traffic management and system administration related to transmission 
jobs and packet transmission. These controllers also process the packets to help assist in the 
control of the internal switching of the switching network. The switching network of the 
packet switch performs space-division switching which switches each packet from its source 

10 link to its destination link. 

There are many known architectures for switching networks. The important 
characteristics for a switching network are self-routing for high speed switching, short 
transmission delays, low delay variance, good fault tolerance for high quality service, and 
high reliability for easy maintenance. Generally, the switching networks are composed of 

15 several switching stages with a web of interconnections between adjacent stages. These 
networks are called Multi-stage Interconnection Networks (MIN). Each stage consists of 
several basic switching elements where the switching elements perform the switching 
operation on individual packets for self-routing of the packets. Self-routing enables each 
packet to be processed by the distributed switching elements without a central control scheme, 

20 and thus high speed switching can be done. 

Figure 1 shows a conventional two dimensional mesh computer network system 100 
with nine computation nodes 110. In the conventional two dimensional mesh network 
system 100, horizontally arranged nodes are connected to form a horizontal loop 150 and 
vertically arranged nodes are connected to form a vertical loop 160. Each node comprises a 

25 switching element and a processing element connected to the switching element. Each 
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switching element in figure 1 has five inputs and five outputs. Four input and output ports 
are used for global message transfer and the other one input/output port is used for the 
message transfer from/to the local processing element. The message or data exchange 
among the nodes for parallel processing happens through the connected wires. 
5 While this network structure works well for small network, it becomes increasingly 

inefficient as the size of a network increases because mean number of hops between a source 
and sink increases proportionally with the number of nodes per loop. 

In contrast to the computer network system 100, the telecommunication switching 
system uses only switching elements without local processing element. The most well 

10 known switching system is Clos network 200 in figure 2 where input switches (first stage) 
210 are connected to output switches (third stage) 230 by middle stage switches 220. 

The Clos network 200 does not have any local input/output ports for local processing 
element. The processing elements are in the front of first stage 210 or at the end of third 
stage 230. So the number of local input link is n x g and the local output link is also nxg. 

15 However, in the Clos network 200, the number middle stage switches 220 should be 

greater than 2 x n, to be non-blocking. Accordingly, it becomes increasingly inefficient as 
the size of a network increases 

Omega network consists of n switching stages (where n=log2N stages with N being 
the number of input ports and the number of input ports, i.e. the number of input and output 

20 ports being the same is a "square size" network). Each of the n switching stages is 
composed of N/2 basic switching elements and each switching element performs 2x2 
switching. In Omega switching network there is only one path to one source and destination 
pair. Accordingly, if a connection becomes faulty, then some traffic will be lost. Further 
more, as the size of the network increases, switching time for transferring date or information 

25 increases. 
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Figure 3 shows a 8x8 Omega switching network 300. The input link 341 and output 
link 342 have a different protocol from the internal link 343. Generally the input packets 
are reformatted to have internal header information for self-routing in the input protocol 
processor 310 and output protocol processor 320. The internal switching network 350, so 
5 called fabric, has all same protocol connections 343. There are two times protocol 
conversions in the switching system 300; one from input link 341 to internal link 343 and the 
other from internal link 343 to output link 342. These conversions happen in the input 
protocol processor 310 and output protocol processor 320. These protocol processors 310 
and 320 decouple one side protocol from the other side protocol. In the figure 3, if a 
10 connection becomes faulty, then some traffic will be lost because there is only one path to one 
source and destination pair, so it is not fault tolerant. 

European patent application number EP1176770A2 by Beshal et al., discloses multi- 
dimensional lattice network comprise a plurality of sub-net 400 as shown in Fig. 4. In each 
sub-net 401, input/output links 402 interconnect data source and sink with edge switch (edge 
15 module) 408. The edge modules 408 are in turn connected to N core stages 414 by core 
links 412. Because source and sink are connected by the edge modules 408, total traffic 
amount increases proportionally with the muti-dimensional system volume. However, it 
requires a plurality of core stages 414(core switches). 

Fault tolerant becomes more important when the system becomes bigger and it is 
20 used by more people. The backbone switching systems switching all data in one city should 
be designed with high fault tolerance and high reliability. 

Accordingly, there is a need for a cost effective, fault tolerant, and a robust system at 
any traffic load variation. 

25 
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SUMMARY OF THE INVENTION 

One exemplary embodiment of the present invention is directed to a multi- 
dimensional disconnected mesh switching network where local data source and sink are 
connected to a broken links by input and output protocol processor. The disconnected mesh 
5 network can be called as a lattice switching network, which has local connections on the 
surface of the network physical shape. 

In one embodiment of present invention, the switching elements have more 
connections to provide some shortcut paths to the destination port. The shortcut path could 
be a diagonal connection to an adjacent switching element or it could be an arbitrary length to 
10 a far apart switching element. 

The open shortcut (jumping) connections of boundary switching element or located 
nearby the boundary provide more input output ports, some of them can be used for the 
increase of fault tolerance by providing extra connections. 

The present invention will be more fully understood in the view of the following 
15 descriptions and drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a schematic diagram of a conventional two dimensional mesh network. 
Fig. 2 is a schematic diagram of a conventional Clos network. 
20 Fig. 3 is a schematic diagram of a conventional Omega switching network. 

Fig. 4 is a schematic diagram of a sub-net of edge modules interconnect by a core 
switch according to a prior art. 

Fig. 5 is a schematic diagram of a two dimensional disconnected mesh network 
according to the present invention. 

25 
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Fig. 6 is a schematic diagram of a three dimensional disconnected mesh network with 
54(6x9) 10 links according to the present invention. 

Fig. 7 is a schematic diagram of a two dimensional disconnected mesh network with 
diagonal jumping routes in the Fig. 5. 
5 Fig. 8 is a schematic diagram of a two dimensional disconnected mesh network with 

diagonal jumping routes and control processors in the Fig. 5. 

Fig. 9 schematically illustrates relative location propagation steps in the two 
dimensional invented network according to the present invention. 

Fig. 10a is a schematic diagram of two dimensional broken mesh network with 
10 reduced number of switching elements, while the number of 10 links is maintained same 
when there is no jumping route in the Fig. 5 and Fig. 10b is a schematic diagram of two 
dimensional broken mesh network with reduced the number of switching elements, when 
there are jumping routes in the Fig. 5. 

Fig. 1 1 is a schematic diagram of a derived multiplexer and demultiplexer from the 
15 basic switching elements according to the present invention. 

Fig. 12 is a schematic diagram of a switching system with several multiplexers and 
de-multiplexers on the surface of switching block to make the traffic load low according to 
the present invention. 

Fig. 13 schematically illustrate six different routing paths from {k, I) switching 
20 element to (k+2, 1+2) switching element in Fig 5. 

Fig. 14 schematically illustrates an example of bypassing path for a faulty switching 
element in the Fig. 5. 

Fig. 1 5 schematically illustrates an example of detouring path to avoid the hot-spots 
in the Fig. 5. 

25 
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Figs. 16a and 16b schematically illustrate a packet formats passing through the 
invented switching system. 

Fig. 17 schematically illustrates how data packet is changed during self-routing via 
routing path (2) in Fig. 13. 
5 Fig 18a is a schematic diagram with reduced switch elements in the central part in 

Fig. 5 

Fig. 18b is a schematic diagram with tweaked interconnection in Fig. 5 
Fig. 18c is a schematic diagram with irregular connection and with reduced 
switching element in Fig. 5. 
10 Figs. 19a and 19b is a schematic diagram of a system with reduced number wires for 

jumping routes. 

Fig. 20 schematically illustrates connecting two 2-dimensional switching systems 
using broken local links. 

Fig. 21 is a schematic architecture of 4x4 switching element with input and output 
1 5 buffers, which monitors the output buffer level and reports the overload of output buffers. 

Fig. 22 schematically illustrates traffic load controlling by the traffic control 
processor collecting the overload information of output buffers at each switching element. 

Fig. 23 schematically illustrates the information retrieval of the source links passing 
through the overloading output buffer. 
20 Fig. 24 is a schematic algorithm selecting a reasonable path for traffic load balancing. 

Fig. 25 schematically illustrates configurable module board design for rack style 
system installation. 

Fig. 26 schematically illustrates an example of invented system with three 
dimensional housing. 

25 
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Fig. 27 schematically illustrate work space for fault module replacement and air flow 
for system cooling in the three dimensional housing. 

Fig. 28 schematically illustrates three dimensional housing in Fig. 26 with switching 
board and socket and guide means for guiding exchange apparatus. 

5 

DETAILED DESCRIPTION 
All known switching systems have some problems in performance or too expensive 
to implement. Specifically the number of switching elements needs to be decreased. And 
the ratio of available number of input/output ports over total number of internal and external 

10 connections should be improved. The present invention uses the surface connections of 
broken multi-dimensional mesh network; it can be called a lattice network, which has input 
and out ports on the surface of the network system volume. 

A conventional mesh network can be expressed N nodes, where each node has a n- 
tuple coordinates, (di, d 2 , . . ., d n ). There are connections between the adjacent nodes, which 

15 have n-1 same coordinates and the difference of the one different coordinate is plus minus 1, 
±1. Another special connection is the connection between the ending node to the starting 
node at each dimension. For example, the two dimensional mesh network 100 of Fig. 1 has 
9 nodes and each node has 4 connections. Each node can be expressed by two-tuple 
coordinates, (x,y). The y-dimensional and x-dimensional ending node 120 has connection 

20 with the y-dimensional starting node 130 and x-dimensional starting node 140. Such 
interconnection connecting starting node and ending node is so called wrap-around link. 
When the each connection in the mesh network is unidirectional, the mesh network is called 
as an unidirectional mesh network. It is called bidirectional mesh network if each 
connection has bidirectional connections. 

25 
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Referring to Figs. 5 and 6, multidimensional broken mesh network is described. 

Fig. 5 shows two dimensional broken (or disconnected) mesh network 500 where the 
input/output protocol processor 510 converts the input/output link protocol to internal link 
protocol 540. Unlike conventional mesh network 100 of Fig. 1, a basic switching element 
5 520 does not have connection to the local traffic source or sink. All traffic sources and sinks 
530 are connected on the boundary of the broken mesh network 500. Input and output 
protocol processors 510 connect the basic switching element 520 and traffic source and link 
530. 

In Fig. 5, there are 9 switching elements 520 and 12 bidirectional traffic links 530. 

10 The possible longest routing path contains 5 switching elements, when the routing method is 
assumed to choose the shortest path. 

The difference of figure 5 from conventional mesh network in figure 1 is that the 
wrap-around connection 150, 160 connecting the starting node and the ending node is 
disconnected and the end points of the disconnected links are connected to the input output 

1 5 protocol processor 510. 

When two dimensional broken(or disconnected) mesh network 500 of Fig. 1 is 
expanded into n dimensional broken mesh network, the n dimensional broken mesh network 
is composed of N switching elements, each switching element has its own n-tuple coordinates, 
expressed (di, d2, . . ., d n ). Where di can vary from 1 to Di, and d2 can vary from 1 to D2, and 

20 so on. The total number of switching nodes, N, is obtained DixD 2 x. . .xD n . Each switching 
node has 2xn connections to the adjacent nodes, which has («-l) same coordinates and the 
other one coordinate different from the switching node by ±1. There are 2x« 
disconnected surfaces of the normal mesh network and each surface has several disconnected 
links. The traffic trunk or link is connected to the disconnected links. There are two 

25 surfaces for one dimensional axis, for example, the surface nodes of k-th dimension have 
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coordinates (di, d 2 , . . ., d k =T . . ., d n ) or (dj, d 2 , . . ., dk=Dk . . ., d n ), where di can vary from 1 to 
Di, and d 2 can vary from 1 to D 2 , and so on. . And the number of links for k-th dimensional 
surface are 2x(D]XD 2 x. . . Dk-ixD k+ i . . .xD n ). 

Figure 6 shows a three dimensional disconnected mesh network 600 with 54 external 
5 links 630. The three dimensional disconnected mesh network 600 has 27 switching 
elements implementing 6x6 switching. Each switching element has 6 bidirectional links 
and thus there are 27x6 bidirectional connections from all switching elements; 54 connections 
are used for external traffic trunks and 108 connections are used for internal connections 
between switching elements. The percentile of external links among total switching 

10 connections reaches 33 percent. 

As described in Fig. 5, in Fig. 6, 27 broken wrap-around links are connected to 54(2 
x 27) external links 630 through input and output protocol processors 610. 

To reduce the routing delay in the broken mesh switching network, Fig. 7, shows a 
shortcut routing 770, so called jumping route, into diagonal direction. Each switching 

15 element 720 has 8 connections 720(In Fig. 5, each switching element has 4 connections). 
The increased jumping routes 770 reduce the longest routing path in the switching system. 
The longest routing path in Fig. 7 passes through 3 switching elements. The external data 
link 730 connected to input output protocol processor 710a has 3 internal connections 740 
compared to 1 connection in Fig. 5. These extra connections can be used for the higher fault 

20 tolerance. Even when one of the three internal links is out of order, the system can operated 
without any serious problem. These extra connections, also, prevent a system fault even 
though the nearest switching element 720e to the switching element 710a goes out of order 
by allowing communication to the adjacent switching elements 720e', 720e". The 
introduction of diagonal jumping route introduces dangling diagonal link 750, which can be 

25 used for system control purpose or for extra input output external data links. 
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The jumping route can be defined several ways. The example shown in Fig. 7, has 
jumping route connections between two nodes having n-2 same coordinates and the 
difference of the other two different coordinates are ±1. For the efficiency of invented 
switching network, arbitrary jumping route can be added. 
5 Fig. 8 shows four system traffic control processors 880 to the dangling diagonal links 

75, 850. These processors 880 are also connected each another by the control system bus 
890, through which the system information are synchronized among the control processors. 
All switching elements 820 reports its over-loading situation to the nearest control processor 
assigned to each switching element. For the higher system fault tolerance, the control 

10 system bus also can be duplicated. 

Figure 9 shows how the coordinates of each switching elements can be defined at the 
system booting time. In the complex modular switching system, physically defining the 
location coordinates will make the system more complex. The solution is a dynamic 
location propagation approach from some fixed locations or assigning the location 

15 information from system control processor attached somewhere in the switching nodes. 
There are two starting points 910sl and 910s2. By propagating the location allocation 
message, the wave front nodes are assigning their coordination value. After one message 
transfer period, the first nodes on the propagation line will assign their coordination number 
and at the next location message transfer period the location information are propagated to 

20 nodes on the second propagation line. Namely, at first, coordinate value (1, 1) is allocated 
to a switching element 920a which is connected to the starting processor 910sl (see wave ®). 
After node on the wave ®, switching element 920a, is determined, location allocation 
message is propagated into front nodes 920b, 920c, 910d, i.e., switching elements 920c, 920b 
and protocol processor 910d based on the switching element 920a. 

25 
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Based on the description of this invention in previous pages, further embodiments 
can be implemented. 

Figure 10a and 10b shows how to reduce the number of switching elements from the 
basic disconnected mesh network. In Fig. 10a, some corner nodes are removed from 
5 original two dimensional disconnected mesh network 500 of Fig. 5. Each corner nodes 1020 
is connected to 3 input and output protocol processors 1010. 

Fig. 10b shows the switching network after reducing the corner nodes and using each 
dangling nodes as a one external traffic link. There are 5 switching elements 1020 
implementing 8x8 switching and 24 external links 1030. The percentile of external links 
10 among total connection links reaches 60 percent. 

The basic switching elements developed for the invented disconnected mesh network 
can be used several different ways. Figure 11 shows multiplexer and de-multiplexer 
application of the switching element. A 4x4 switching element 1110 can be connected as 
1120 with bi-directional internal links. When a traffic data or packet moves into right, the 
15 system 1100 works as a de-multiplexer or distributor. When a traffic data moves into left, 
the system 1100 works as a multiplexer or concentrator of traffic. 

Fig. 12 shows how the multiplexer and de-multiplexer can be used to deal with high 
speed traffic trunk. The input output protocol converter 1210 receives high speed traffics 
1230 and the multiplexer/de-multiplexer 1220 distributes/collects into/from lower rate traffic 
20 links. This multiplexer/de-multiplexer 1220 reduces the traffic load in each link of the 
switching system 1200. So that the system can handle high speed traffic links without any 
bottleneck by using more switching resources. The capacity of the switching fabric is 
4Nx4N, because each link at both sides is bidirectional. When the capacity of switching 
fabric is expressed in high speed traffic link 1240, it is 4x4 high speed trunk capacities. 

25 
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The fault tolerance of invented system is inherited from the many possible ways of 
routing even without the jumping routes 730 of Fig. 7. Fig. 13 shows 6 routing paths from 
the switching element, (k,l) to the switching element, (k+2,l+2). A message following path 
2 passes the switching elements, (k+l,l), (k+l,l+\), (k+2,l+l), and (k+2, 1+2). When there is 
5 a faulty switching element, it can be bypassed by selecting another available route. Fig. 14 
shows an example bypassing a fault module. 

The intrinsic characteristic of multiple routes, also, can be used to control the traffic 
load. When a new traffic is being allowed, the possible routes can be searched for better 
system performance. Fig. 15 shows the example of avoiding the hot spots to get higher 

10 throughput. If there is no route with sufficient traffic capacity, then some hot spots can be 
controlled by reducing the traffics passing the hot spots. 

The switching at each switching element is self-routing which is known by several 
prior works including the bypassing Omega network also invented by me. There could be 
two self-routing methods; dynamic self-routing and static self-routing. Dynamic self- 

15 routing carries only the destination address and the traffic route will be dynamically decided 
at each switching element. The destination address will be subtracted from the current 
address and the difference will be calculated. When there are several different coordinates, 
one appropriate output direction will be chosen to reduce the difference to the destination. 
So the routing paths of dynamic routing will vary packet by packet. Static self-routing 

20 carries all route information determined at the input protocol processor 510. Each switching 
elements reads the first or a fixed bit positions to get the routing direction inside the 
switching element. When a data packet is delivered to the next switching element, the 
current switching element will change the packet, so that the next switching element also can 
do the same operation to get the routing direction at the next switching element. The 

25 operation to make this regularity can be a shifting of static routing information or counter 
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increment to indicated the next routing bits. 

Figs. 16a and 16b show some possible data packet formats which will travel inside 
the switching system. The data packet and control packet can be differentiated by a leading 
bit or bits 1610 1660, which also can be combined with priority information. If the 
5 switching system handles dynamic self-routing the packet will contain the destination address 
or destination coordinates in n-tuple format 1620. There could be several similar 
embodiments which can be obtained by simple modification from the explained example 
when an expert wants to implement while following exact the same principle. The traffic 
packet for static self-routing will have the sequences of routing direction 1620 as shown in 
10 figure 16. 

Fig. 17 shows how the traversing packet data can be changed for self-routing at each 
switching element on the path (2) in Fig. 13. 

There can be some connections between adjacent output protocol processors. If 
there is no connection between output protocol processors, then the packet arrived to a 

15 surface switching node where a output protocol processor attached should not deliver the data 
to the nearest output protocol processor if the output protocol processor is not the destination 
of the packet. For example the traffic packet arriving at node 720e destined to output 
protocol processor 710b should not be delivered to output protocol processor 710a. Because 
there is no connection between two protocol processors, 710a and 710b, the packet can not be 

20 transferred from output protocol process 710a to output protocol processor 710b. So the 
dynamic self-routing also may carry the exit direction at the last switching element, which is 
pointed by destination coordinate 1650. Otherwise the carrying destination coordinate will 
be that of the target output protocol processor and the surface switching element will 
recognize somehow itself that it is the surface switching element, and it will adopt the routing 

25 limitation not to deliver to the attached protocol processor if the destination coordinate does 
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not match exactly. 

Further reduction on the number of switching elements can be obtained by allowing 
some irregularity on the internal switching elements connections. Fig. 18a shows the 
invented broken mesh network with some removed switching elements in the middle of 
5 regular connections. The hashed switching elements have far-jumping connections 1810 or 
others. This irregularity will not cause any serious performance in the system performance 
or throughput. 

Fig. 18b shows one removed switching element 1820 and two tweaked traffic 
connections 1840. The example routing 1830 can be done by 5 switching hops, which may 

10 take 7 hops if there were no changes 1820 1840. Fig. 18c shows irregular connections. 
Switching element 1850 has 4 diagonal connections and switching element connected thereto 
has 5x5 switching operation. A variation of embodiment can be achieved by merging several 
long jumping routes into a bigger trunk as shown in figure 19. 

Due to such jumping route and irregular route, self-routing needs to be modified. 

15 For dynamic self-routing, each switching element must have coordinate value calculated by 
the difference between coordinate of a switching element connected to the output of each 
switching and coordinate of the present switching element. For static self-routing, internal 
protocol processor or traffic control processor must have information about irregular 
interconnection. Difference value (delta value) or distance value is 1 or ±1 when there is no 

20 jumping route. However, in the presence of jumping route, difference value can be varied. 
For example, in Fig. 7, switching element 720e has a diagonal jumping route input and output 
protocol processor 710b and the output terminal of the switching element 720e has a distance 
value (-1, +1). Namely, the position of the packet traveling through arbitrary output 
terminal is changed to the extension of the distance value. Each output terminal of the 

25 switching element can have a variety of distance value. 
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As shown in Fig. 19a, a plurality of long jumping routes 1940 can be concentrated. 
For example, four 1 Mbps long jumping route 1940 can be replaced by 4 Mbps time division 
multiplexed(TDM) trunk 1930 using 4:1 multiplexer 1910 and 1:4 demultiplexer 1920. 

Further increment of input output external links can be achieved by increasing the 
5 dangling nodes on the surface of multi-dimensional broken mesh network volume. One 
embodiment can be connecting several multi-dimensional broken mesh with some 
irregularities of connection. Fig. 20 shows two switching planes connected by some 
irregular internal connections 2030 2040. Each switching node has two external traffic 
connections, the boundary switching nodes have 3 external connections, and the vertex 

10 switching nodes have 4 external connections. 

The invented multi-dimensional broken mesh network uses one or several modular 
switching elements. Fig. 21 shows one embodiment of 4x4 switching element. The switch 
is designed for two dimensional broken mesh network which has 4 input ports from direction, 
-x, +x, -y, and +y. There are 4 output directions as same as the input directions. There are 

15 4 input buffers 2190, 2191, 2192, and 2193, which does back pressure to the previous output 
buffer as 2150, 2151, 2152, and 2153. Each output buffer has a mechanism to detect 
whether the output buffer level has exceed the water mark of overloading 2182. When a 
overloading detected at one output buffer the output buffer will be inserted with overloading 
report control message. The insertion of overloading message can be happen into the 

20 overloading output buffer or another buffer with less traffic also. The input buffer can be a 
dual ported RAM(random access memory) or a single ported memory the writing from input 
and reading to output happens at each another cycle. Or two or more separated single 
ported memory can be used and accessed independently at the same time. Even some more 
variation can be achieved. 

25 
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One embodiment of the switching element is not to implement the backpressure 
mechanism between output buffer and input buffer. The output buffer can receive several 
packets at the same time from different input buffers. When one or more output buffer 
becomes full, some packets from winning input buffers at the output buffer contention will be 
5 discarded with discarded, because they can not be saved into overflowing output buffer. If 
the system allows the backpressure from output buffer to input buffer, then the traffic load 
control at the system level will become more important, which will be explained at the later 
of this document. 

There is one unique characteristic in the basic switching element. The traffic from 

10 one direction will not go to the same direction, which is explained the dotted circle connected 
to output buffer 2150. Only traffics from -x 2120, +y 2130 and -y 2140 can go to the +x 
direction 2150. This characteristic is not unknown but it becomes unique when it is 
combined with the invented multi-dimensional broken mesh network. 

The basic switching element also need to monitor whether any special control 

15 message are entered into the input buffer. For example the system can be initialized by 
propagating the location allocation message. When a local controller of one input buffer 
reports the entrance of control message to the main controller in the switching element, the 
main controller will read out the control message and process it. After the processing of a 
control message, if it is required then the main controller will insert some response, 

20 broadcasting or reporting message will be inserted into appropriate output buffers. 

All communication traffics need to be under load control for several reasons; 
authentication, service usage charge, traffic load balancing for better performance at et al. 
The invented multi-dimensional broken mesh network intrinsically has a good controllability. 
Figure 22 shows an example of traffic control in the invented switching network. There are 

25 several buffers with many different occupied levels. The output buffer stacks up when the 
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arriving input packets during one packet transfer period are more than one. The input buffer 
also will stack up if the simultaneously transferable packet number into an output buffer is 
less than the total input number minus 1 and the input buffer looses at the contention of 
output buffer request. If there is a backpressure mechanism between input buffer and the 
5 previous output buffer, then only monitoring the output buffer would be sufficient to control 
the system overload. In Fig. 22, the output buffer 2210 becomes overloaded by detecting 
the overload water mark was passed. Then the overloading information will be reported to 
the traffic controller 2220. The traffic controller 2220 will request a load reduction requests 
to all input link protocol processors which have traffics passing through the overloaded 

10 output buffer 2210. The input protocol processor may do some traffic load management 
work, so it can be called as an input link processor. 

Fig. 23 shows one possible basic data structure for the traffic load control in the 
invented system. Each switching element data structure 2310 has all pointers for each 
output buffer data structure. Each output buffer data structure 2320 has all traffic 

15 information, where the traffic information has source link number, traffic identification 
number at input link processor and the capacitance of allowed traffic. At each input link 
processor or in the traffic controller, there will be all traffic information 2330 including traffic 
identification in the switching element and the destination coordinate of output link processor, 
all routing paths which are assigned to carry the traffic and the allocated capacitance of each 

20 routing path. Fig. 23 is just one example data structure of several possible embodiments of 
invented network system control. This may not be the first or unique enough for claims, but 
it becomes very unique and powerful claim when it is combined to the invented network 
system. 

Further example of system load control can be illustrated from Fig. 24. Even 
25 though the current internet connection from home is not charged by traffic yet. In some day, 
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all data traffics will be measured and it will be charged based on the usage. To measure the 
traffic, at the start of any communication the required bandwidth is requested 2410 to the 
invented switching system residing on the backend of internet. Then the input link 
processor makes a list of all possible routing paths or some sufficient number of routing paths 
5 2420. For each routing path in the list, the requested bandwidth is evaluated whether it can 
be carried by the routing path 2430. If the request traffic request can be carried 2440, then 
the path is assigned to the requested traffic 2490 and the information is stored as described in 
figure 23. Otherwise the examined routing path is stored into sorted list, AA, 2450 and the 
available bandwidth, BWSUM, is added with the possible bandwidth from the current path. 

10 If the list, AA, is empty the BWSUM is the possible bandwidth of the current path. If no 
sufficient routing path is found and another path is available for search, then the processing 
loop, 2430, 2440, 2450 or 2490, is re-evaluated. Otherwise the BWSUM is checked against 
the requested bandwidth BW 2470. If the BW is less than or equal to BWSUM, then the 
traffic is accepted with several routing paths and the traffic is distributed into several routing 

15 paths. If the required bandwidth BW is not available then the requested traffic is discarded 
and replied with NAK(no acknowledge) 2480. If there is no one sufficient routing path, the 
algorithm tries to allocate the traffic to the bigger traffic routing routes. 

Generally a complex switching system is built on a cabinet style tall rack. If the 
system is very complex, then it may be built into several racks. The rack is composed of 

20 several selves, on which several line cards are installed. The invented system is composed 
of tightly coupled basic switching elements, which makes difficult to identify a simple 
modular line card. Figure 25 shows a configurable line card. There are 6 basic switching 
elements and two input output link processor. From one line card board, it can be 
configured into several configurations, such as config(O), .... config(k). Config(O) equipped 

25 with two input output link processors 2510 2520, but the configuration, config(k) equipped 
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with only one left link processor 2530. The 6 switching elements in config(O) have a 
parallel connection, but they are connected into serial topology in config(k). Using some 
limited line card printed circuit boards to make several topology of switching elements will 
help system builder. 

5 The embodiment of this invention can be implemented when the switching elements 

are built up into a cell structured three dimensional volume, on the surface of which the 
traffic links are connected. There will be lots of regular jumping connections inside the 
volume and each input and output link will be connected with several internal links to reduce 
traffic load inside the switching elements volume and to increase the fault coverage. Fig. 26 

10 shows a sphere shape switching system 2610 and the cage 2620, which is housing the sphere 
shape switching system. The three dimensional square shape volume will be composed of 
three dimensionally stacked cube space cells or xyz selves or frames 2640. Along the three 
dimensionally placed frames or bars 2640, the routing signal lines will be routed into adjacent 
switching elements. On the surface of the sphere all external traffic link will be connected. 

15 And the traffic data will be routed through normal disconnected mesh network or jumping 
routes. One example routing path is shown in Fig. 26 with curved trace 2610. Each 
switching board 2650 mounting one or more switching elements is placed into one cube cell 
2630 of the housing cage. Each switching board is mounted in the cube cell through socket 
and wiring is formed to the socket along the frame 2640. Cube cell 2630 assembles together 

20 to form a square volume 2620. Some of the cube cell located at corner can be removed to 
form sphere shaped switching system. 

Invented unique system housing method achieves good fault maintenance and system 
cooling. Fig. 27 shows several views of the invented three dimensional system housing 
2720. There is a system cooling fan 2710 making the air flow from left to the right taking 

25 away the generated heats from switching element. The system can be implemented into 
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several subsystems with same structure as shown in Fig. 27. The switching elements are 
attached to the selves or bars 2780 which also used as a guide structure of signal routing 
wires. These frames also can be used for system cooling by passing through a coolant 
inside the frame or connected to the low temperature object, so that the frame itself carries 
5 out the heat generated in the middle of the three dimensional volume cage. 

The front view 2750 shows the vertical and horizontal frames making a space for the 
mounting of switching elements or modules. The space of each one cell 2740 can be 
spacious reasonably. This space can be used to replace a faulty switching element on-the- 
fly using my human arm, micro-machine or the other apparatuses. The side view 2730 also 

10 shows some space per cell structure, so that the cooling air can be easily moved away with 
system heat. The top view 2760 shows the switching element or module which composing 
the invented switching system. 

All trunk lines of the invented system need to be connected to the surface of 
switching system volume. If it is physically connected on the evenly distributed surface 

15 points, then it can be obstacle for the system maintenance. One way is to connect from the 
evenly distributed points, by using another segment of wire to collect the physical connection 
point of input output trunk. For example, if there are 100 pints of input output link 
connection are on the front surface 2720, those 100 links can be physically collected to the 
lower right corner of the front surface 2750. 

20 Fig. 28 schematically illustrates three dimensional housing in Fig. 26 with switching 

board and socket and guide means for guiding exchange apparatus. Referring to Fig. 28, 
switching board mounting one or more switching element is mounted in the cube cell 2830 
though socket 2860 and wiring 2870 is formed to the socket 2860 along the frame 2840. 
Guide means 2880 is formed in each cell 2830. Guide means 2880 is a kind of rail and is 

25 formed upper sidewall of the cell 2830. Exchange means 2890 is inserted into the guide 
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means 2880 and moves back and forth along the guide means 2880. Exchange means 2890 
comprises an inserting part 2891 inserted into the guide means 2880, holding part 2893 for 
holding the switching board, and moving means 2895, 2897 for moving the holding part 2893 
to hold the switching board. The moving means 2895, 2897 can be made of screw. 
5 Depending on the direction of the screw, the holding part 2893 moves up and down, back and 
forth. After the exchange apparatus 2890 is inserted in the guide means 2880, the exchange 
apparatus 2890 moves toward the switching board to be exchanged. Moving means 2895, 
2897 is then manipulated to open the holding part 2893 and hold the switching board. After 
holing the switching board, the exchange 2890 moves back out of the guide means 2880. 

10 In the various embodiments of this invention, novel structures and methods have 

been described for an efficient packet switching system. The various embodiments of the 
structures and methods of this invention that are described above are an exemplary of the 
principles of this invention and are not intended to limit the scope of the invention to the 
particular embodiments described. For example, in the view of this disclosure, those skilled 

15 in the art can define other expression of surface and jumping routes, system load control 
methods, switching element reduction methods, connection methods of several invented 
architecture, system element co-packaging method, several switching element partitioning, 
system element housing method, system cooling method and so forth, and use these 
alternative features to create a method or system according to the principles of this invention. 

20 Thus the invention is limited only by the following claims. 
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